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Document Imaging and Indexing System 



Technical Field 

[0001 ] The present invention relates to storage and retrieval of digitized 
images of printed documents and, in particular, to a simple document 
imaging system with automatic indexing. 

Background and Summary 

[0002] The development and availability of personal computers and 

personal printers have brought with them repeated predictions that the 
paperless office is at hand. It is not yet so. Instead, the use of office 
bond paper continues to grow year after year. Even workplaces that 
minimize the generation of paper (i.e., printed) documents by use of e- 
mail, online and networked resources, etc., commonly receive large 
numbers of printed materials and documents. Rather than the paperless 
office, it appears that the foreseeable achievable accomplishment will be 
the management of printed documents. 

[0003] The age-old solution has been to store printed documents in large 
repositories called files. In addition to large amounts of space, such 
repositories require manual indexing systems to keep the documents in 
order for retrieval, as well as staffing for physically placing documents in 
the files and retrieving them. As a consequence, conventional file 
storage systems for printed documents are relatively large and are 
surprisingly expensive to maintain when all costs are considered. 

[0004] In response to the significant costs and requirements of maintaining 
conventional printed document files, computerized or digitized document 
storage systems have been developed. One of the simplest digital 
document storage systems is simply maintaining in electronic form 
documents that are originally generated in that form. For example, 
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computer storage of word processing documents, e-mail 
communications, etc., simply maintains such documents in the electronic 
form in which they were created. 

[0005] Of greater complexity are systems that convert printed or other 
written materials, generically referred to herein as printed documents, 
into a digitized form for storage on computer-readable media. Such 
systems characteristically employ optical scanners that form digitized 
images of the printed documents for storage in a computer storage 
medium, and software for creating indices or other identifying information 
for retrieving the digitized images at a later time. In most such systems, 
indexing information is manually entered by a user into a computer 
system. For example, the indexing information could include 
conventional file reference information of the type used for conventional 
paper files (e.g., file reference names or numbers). 

[0006] This type of digitized document storage system may be a suitable 
substitute for paper document storage in many business contexts. Staff 
who might otherwise by physically storing and retrieving paper 
documents can provide the indexing information and potentially process 
greater numbers of digitized documents for storage, in addition, many 
such business contexts have existing document indexing formats that 
may be applied to the digitized storage. 

[0007] However, such manual indexing might not be suitable in other 

business contexts, such as smaller businesses, or for individual users. 
For these users, the effort of manually indexing 'digitized documents for 
storage can pose a barrier to adoption of digitized document storage. 
For example, there often may not be suitable formal file format for 
indexing the digitized documents. 

[0008] Accordingly, an aspect of the present invention is a document 

digitizing method for digitizing and automatically indexing documents in 
printed form. The method includes optically scanning the document, 
forming and storing a digitized image file from the optically scanned 
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document, optically recognizing characters in the optically scanned 
document, and forming and storing a text file of the optically recognized 
characters in document The text file and the digital image file for a 
document are associated with each other. For example, the associated 
text and digital image files may have a common name and may be 
distinguished by appropriate file extensions. 

[0009] The digital image file and the text file together represent a digitized 
document data structure that combines a digital image of a document 
with a text file of optically recognized characters in the digital image. The 
text file functions as a searchable index for retrieving the digital image 
files corresponding to the document. As a result, the text file functions 
as an automatically-generated index of the digital image file and the 
document pages they represent. In one implementation, the document 
includes plural pages and a separate digitized image file and text file is 
formed for each page of the document. 

[0010] Another aspect of the invention is a retrieval method for retrieving 
the digitized image file for a document. The retrieval method includes 
searching the text files to identify any having a selected text string and 
providing access to the digitized image files that correspond to those text 
files. For example, the access to the digitized image files may include 
allowing a user to selectively display any digitized image file that 
corresponds to an identified text file. 

[001 1] Additional objects and advantages of the present invention will be 
apparent from the detailed description of the preferred embodiment 
thereof, which proceeds with reference to the accompanying drawings. 
Brief Description of the Drawings 

[0012] Fig. 1 illustrates an operating environment for an embodiment of 
the present invention. 

[0013] Fig. 2 is a flow diagram of a document digitizing method of the 
present invention that can provide simple automatic imaging and 
indexing of digitized documents. 
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[0014] Fig. 3 is a block diagram representing a digitized document data 
structure according to the present invention. 

[0015] Fig. 4 is a flow diagram of a digitized document retrieval method for 
retrieving digitized documents stored in accordance with the document 
digitizing method of Fig. 2. 

[0016] Fig. 5 is a simplified diagram of an exemplary graphical user 
interface for the digitized document retrieval method of Fig. 4. 
Detailed Description of Preferred Embodiments 

[0017] Fig. 1 illustrates an operating environment for an embodiment of 
the present invention as a computer system 20 with a computer 22 that 
comprises at least one high speed processing unit (CPU) 24 in 
conjunction with a memory system 26, an input device 28, and an output 
device 30. These elements are interconnected by at least one bus 
structure 32. 

[0018] The illustrated CPU 24 is of familiar design and includes an ALU 34 
for performing computations, a collection of registers 36 for temporary 
storage of data and instructions, and a control unit 38 for controlling 
operation of the system 20. The CPU 24 may be a processor having any 
of a variety of architectures including Alpha from Digital, MIPS from 
MIPS Technology, NEC, IDT, Siemens, and others, x86 from Intel and 
others, including Cyrix, AMD, and Nexgen, and the PowerPC from IBM 
and Motorola. 

[0019] The memory system 26 generally includes high-speed main 

memory 40 in the form of a medium such as random access memory 
(RAM) and read only memory (ROM) semiconductor devices, and 
secondary storage 42 in the form of long term storage mediums such as 
floppy disks, hard disks, tape, CD-ROM, flash memory, etc. and other 
devices that store data using electrical, magnetic, optical or other 
recording media. The main memory 40 also can include video display 
memory for displaying images through a display device. Those skilled in 
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the art will recognize that the memory 26 can comprise a variety of 
alternative components having a variety of storage capacities. 
[0020] The input and output devices 28 and 30 also are familiar. The input 
device 28 can comprise a keyboard, a mouse, a physical transducer 
(e.g., a microphone), etc. In addition, input device 28 includes an optical 
scanner that optically scans printed and other written documents or 
materials (together referred to as printed documents) to generate 
digitized images of them. The output device 30 can comprise a display, 
a printer, a transducer (e.g., a speaker), etc. Some devices, such as a 
network interface or a modem, can be used as input and/or output 
devices. 

[0021 ] As is familiar to those skilled in the art, the computer system 20 
further includes an operating system and at least one application 
program. The operating system is the set of software which controls the 
computer system operation and the allocation of resources. The 
application program is the set of software that performs a task desired by 
the user, using computer resources made available through the 
operating system. Both are resident in the illustrated memory system 26. 

[0022] In conjunction with the referenced optical scanner input device 28, 
computer system 20 includes software for controlling the optical scanner 
and for generating digitized images of scanned documents. Computer 
system 20 also includes optical character recognition software, as is 
known in the art, for discerning under computer control text characters in 
a scanned document and generating a corresponding text computer file. 

[0023] In accordance with the practices of persons skilled in the art of 
computer programming, the present invention is described below with 
reference to acts and symbolic representations of operations that are 
performed by computer system 20, unless indicated otherwise. Such 
acts and operations are sometimes referred to as being computer- 
executed and may be associated with the operating system or the 
application program as appropriate. It will be appreciated that the acts 
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and symbolically represented operations include the manipulation by the 
CPU 24 of electrical signals representing data bits which causes a 
resulting transformation or reduction of the electrical signal 
representation, and the maintenance of data bits at memory locations in 
memory system 26 to thereby reconfigure or otherwise alter the 
computer system's operation, as well as other processing of signals. 
The memory locations where data bits are maintained are physical 
locations that have particular electrical, magnetic, or optical properties 
corresponding to the data bits. 

[0024] Fig. 2 is a flow diagram of a document digitizing method 50 of the 
present invention that can provide automatic imaging and indexing of 
digitized documents. Digitizing method 50 employs conventional optical 
scanning of written or printed materials or documents to generate digital 
images of documents and automatically generates an indexing file to aid 
in retrieval of the documents. 

[0025] It will be appreciated that references to "printed documents" or 

"written or printed materials" are inclusive of virtually any paper or other 
medium with text characters on it. There may be images or pictures 
interspersed with the text characters, and some pages of a document 
may have no text characters at all. For best utilization of the present 
invention, at least some of the text characters on at least one page of a 
document will be discernible by optical character recognition software. 

[0026] Process block 52 indicates that a document is optically scanned to 
form a digital image file 54 (Fig. 3) for each page of the document. At 
least one page of the document includes text characters discernible by 
optical character recognition software. In an exemplary implementation, 
each digital image file 54 may be of a Tag Image File (.tif) format or 
another lossless image format, or may alternatively be of a lossy image 
format such as JPEG. In addition, each digital image file 54 may be 
compressed, such as by CCITT Group 4 compression for .tif files. It will 
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be appreciated that other compression formats may be used for .tif file 
format images, as well as other lossless or lossy file formats. 
[0027] Process block 56 indicates that digital image computer file 54 for 

each page of the document is stored under a file indicator or name that is 
selected in a predefined manner. In one implementation, digital image 
files 54 may be stored under numeric, alphabetic, or alphanumeric file 
indicators or names that increment sequentially for all digital image files 
54 generated by method 50. For example, document digitizing method 
50 may over time be applied to thousands of documents encompassing 
thousands of digital image files 54. The file indicators or names for the 
pages of a most recent document could be the next successive numeric, 
alphabetic, or alphanumeric in sequence from the preceding digital 
image files 54. 

[0028] Process block 58 indicates that optical character recognition is 

applied to each digital image file 54, or a copy or alternative form of it, to 
discern text characters in and form a text file 60 (Fig. 3) for each 
corresponding page of the document. For example, optical character 
recognition is applied to ail text characters in the optically scanned 
document. Application of optical character recognition to all text 
characters means that optical character recognition is attempted 
throughout the optically scanned document. It will be appreciated, 
however, that due various circumstances, not all text characters will 
necessarily be recognized by the optical character recognition software. 

[0029] In an exemplary implementation, each text file 60 may be of a 

format with minimal or no embedded coding and minimal text formatting, 
such as ASCII characters in a .txt file format. Other text file formats 
could alternatively be used, but the .txt file format is desirable because it 
simplifies the optical character recognition and minimizes the storage 
requirements of text files 60. The optical character recognition may be 
performed by any optical character recognition software, such as any of 
a variety of commercially available optical character recognition software 



7 



1026-037 160226.1 

programs including OmniPage ProTM from Caere Inc., TextBridgeTM 
and Pagis ProTM from Xerox Corporation, and TypeReaderTM 5.0 by 
Expervision, Inc. 

[0030] Process block 62 indicates that text file 60 for each page of the 
document is stored under a file indicator or name that is selected in a 
predefined manner. In one implementation, text files 60 may be stored 
under numeric, alphabetic, or alphanumeric file indicators or names that 
increment sequentially for all text files 60 generated by method 50. For 
example, text file 60 for each page may have the same numeric, 
alphabetic, or alphanumeric file indicators or names as the 
corresponding digital image file 54, but have a different file extension to 
distinguish the text and image files (e.g., .txt and .tif). Such common 
names for corresponding text and digital image files 54 represents a 
simplest manner of correlating corresponding files. 

[0031] In alternative implementations, the corresponding text and digital 
image files 54 could have different names. However, such 
implementations would require an algorithm, a table, or another manner 
of correlating the corresponding text and digital image files 54. 

[0032] Digital image files 54 and text files 60 of Fig. 3 together represent a 
digitized document data structure 64 that combines a digital image of 
each page of the document with a text file of optically recognized 
characters in the digital image. As described below in greater detail, the 
text file functions as a searchable index for retrieving the digital image 
files corresponding to a document. As a result, text files 60 function as 
an automatically-generated index of digital image files 54 and the 
document pages they represent. 

[0033] Fig. 4 is a flow diagram of a digitized document retrieval method 80 
for retrieving digitized documents stored in accordance with document 
digitizing method 50 or having digitized document data structure 64. 
Digitized document retrieval method 80 is described with reference to an 
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exemplary graphical user interface 82 (Fig. 5) that would be rendered on 
a computer display screen. 

[0034] Process block 84 indicates that one or more text strings to be 

searched for within text files 60 are entered by a user. In user interface 
82, for example, a selected text string to be searched for may be entered 
into a text box 86. Text box 86 illustrates a user interface feature for 
searching a single text string, but user interface 82 further allows 
searching of multiple text strings conjunctively, as described below. 

[0035] Process block 88 indicates that a search is commenced, such as 
when a user activates a graphical control like a button 90 in user 
interface 82. 

[0036] Process block 92 indicates that text files 60 are searched to identify 
any with the one or more text strings. 

[0037] Process block 94 indicates that the names of the text files 60 

identified as having the one or more text strings are listed, such as in a 
display for viewing by the user. In user interface 82, for example, text 
files 60 identified as having an initial text string may be listed in a search 
result box 96. Alternatively, the names of the text files 60 identified as 
having the one or more text strings may be listed in a search results 
computer file stored on the computer system to be accessed later by the 
user. 

[0038] A first additional conjunctive text string may be listed in a text box 
98, and a first additional conjunctive text string search may be 
commenced when a user activates a graphical control like a button 1 00. 
Text files 60 identified as having the initial text string of text box 86 and 
the first additional conjunctive text string of text box 98 may be listed in a 
search result box 102. Likewise, a second additional conjunctive text 
string may be listed in a text box 104, and a second additional 
conjunctive text string search may be commenced when a user activates 
a graphical control like a button 106. Text files 60 identified as having 
the initial text string of text box 86 and the first and second additional 
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conjunctive text strings of text boxes 98 and 104 may be listed in a 
search result box 108. The numbers of text files 60 listed in search 
results boxes 96, 102, and 108 may be indicated in respective search 
results file number boxes 1 10, 1 12, and 1 14. A Remove Selected Item 
control 116 initiates deletion of files that are selected or highlighted in 
one of search results boxes 96, 102, and 108. A selected items count 
box 1 18 indicates the number of items that are selected or highlighted in 
one of search results boxes 96, 102, and 108. 

[0039] It will be appreciated that separate controls and search result boxes 
for initial and successive conjunctive text string searches is merely one 
graphical user interface implementation. Alternatively, such conjunctive 
searches may be entered into a single search text box, as is common 
with many computer search tools. Moreover, other implementations 
could include any the Boolean combinations of text strings commonly 
employed with computer search tools. 

[0040] Process block 1 20 indicates that a file name or indicator 

corresponding to a digital image file 54 to be viewed is entered by the 
user. For example, the file name or indicator may be that of a text file 60 
listed in a search results box, such as one of boxes 96, 102, and 108. 
The user may manually enter the file name or indicator, or may enter it 
by selecting (e.g., "single clicking") or activating (e.g., "double clicking") 
text file 60 listed in a search results box. As described above, each text 
file 60 corresponds to a digital image file 54. In user interface 82, for 
example, the file name or indicator may be entered into a text box 122. 

[0041 ] Process block 1 24 indicates that digital image file 54 corresponding 
to the entered file name or indicator is retrieved and displayed, such as 
when a user activates a graphical control like a button 126 in user 
interface 82. 

[0042] Digitized document retrieval method 80 provides retrieval of digital 
image files based upon text strings in corresponding text files 60. As a 
result, text files 60 of digitized document data structure 64 provide an 
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automatic indexing structure for accessing corresponding digital image 
files 54. Sometimes a searched text string will provide access to one 
page of a digitized document when another page of the document is 
actually desired. Accordingly, user interface 82 includes a show next 
image control 128 for displaying the next successive digital image file 54 
and a show previous image control 130 for displaying the immediately 
preceding digital image file 54. Controls 128 and 130 allow a user to 
scroll to successive pages of a document. In this regard, it is desirable 
that digitizing method 50 be applied to documents with their pages in 
regular order or sequence. 

[0043] The implementation of user interface 82 shown in Fig. 5 includes 
features in addition to the features described above with reference to 
digitized document retrieval method 80. For example, user interface 82 
includes a text file directory navigation window 140 listing one or more 
operating system directories or folders in which text files 60 are stored. 
Multiple directories or folders may be used to overcome operating 
system limits on the numbers of files in a directory or folder or to 
organize digitized documents in a user-defined manner. 

[0044] Selection of a directory or folder listed in text file directory 

navigation window 140 accesses the text files 60 in a selected directory 
or folder and lists at least a portion of the text files 60 in a text file listing 
window 142. A second text file listing window 144 allows text files 60 in 
a second selected directory or folder to be listed. Text file count 
windows 146 list the numbers of files in one or all of the directories or 
folders, and a maximum text file count window 148 lists the maximum 
number of text files that can be accommodated. 

[0045] To minimize system resources and time required for repeated 

searches, user interface 82 includes a Load Previous Searches control 
150 operable by a user to retrieve results of previous text string 
searches, with the text strings themselves being listed in a Previously 
Searched Text Strings window 152. For example, the results of 
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searches for the previous n-number of most recent text string searches 
may be stored in a search results file that correlates the text string 
searched with the names of the text files identified in the search. 
Selection of a text string listed in Previously Searched Text Strings 
window 152 loads the corresponding listing of identified text files 60 into 
search result box 96. 
[0046] In an alternative implementation, the search results file may include 
only the previously searched text strings, and not the text file listings 
generated from the previous searches. In this implementation, selection 
of a text string in Previously Searched Text Strings window 152 would 
cause the text string to be copied to search term text box 86, so that 
activation of control 90 would initiate a new search of the indicated text 
string. 

[0047] A previous search term count window 154 indicates a numeric 
count of the number of text strings included in the text string searches 
file, and an "alphabetize" control 156 allows a user to alphabetize the 
listing of text strings displayed in Previously Searched Text Strings 
window 152. 

[0048] A batch search text string window 1 60 lists one or more text strings 
for which searches of text files 60 are to be conducted, such as in a 
batch of multiple successive searches. Such batched searches may 
commonly be distinguished from individual searches for which a user 
would desire search results immediately upon completion of the search. 
A text string may be added to batch search text string window 160 by 
first entering the text string into an entry window 162 and activating an 
add item control 164. A text string may be removed from batch search 
text string window 160 by selecting the text string and activating a 
remove item control 166. The batched searching of text strings listed in 
batch search text string window 160 is commenced upon user activation 
of a batch search graphical control 168 and may continue that are 
executed in the user's absence. It will be appreciated, however, that 
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such batched searching could be used by a user wanting search results 
immediately. 

[0049] Having described and illustrated the principles of our invention with 
reference to an illustrated embodiment, it will be recognized that the 
illustrated embodiment can be modified in arrangement and detail 
without departing from such principles. In view of the many possible 
embodiments to which the principles of our invention may be applied, it 
should be recognized that the detailed embodiments are illustrative only 
and should not be taken as limiting the scope of our invention. Rather, I 
claim as my invention all such embodiments as may come within the 
scope and spirit of the following claims and equivalents thereto. 



13 



